Partial entropy in finite-temperature phase transitions 
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It is shown that the von Neumann entropy, a measure of quantum entanglement, does have its 
classical counterpart in thermodynamic systems, which we call partial entropy. Close to the critical 
temperature the partial entropy shows perfect finite-size scaling behavior even for quite small system 
sizes. This provides a powerful tool to quantify finite-temperature phase transitions as demonstrated 
on the classical Ising model on a square lattice and the ferromagnetic Heisenberg model on a cubic 
lattice. 



Recently, it is found that quantum phase transitions 
can be quantified from the inflexions of the quantum 
entanglement measures [H, S S 0, & @, 0, @, & En- 
close to the quantum critical point, the von Neumann 
entropy, a measure of the quantum entanglement, shows 
finite-size scaling behavior. This method is quite power- 
ful and straightforward for finding quantum phase transi- 
tions in quantum models because one needs neither a pre- 
assumed order parameter nor a considerable large system 
size. A natural question arises: Is it possible to gener- 
alize this method to quantify finite-temperature phase 
transitions in thermodynamic systems? 

There are several established methods to investigate 
the finite-temperature phase transitions, such as exact 
solutions, mean field approach, series expansion, renor- 
malization group analysis, and numerical evaluation of 
the partition function or correlation functions. However, 
each known method has its shortcoming. Only few mod- 
els are exactly soluble. The mean field approach needs 
a pre-assumed order parameter and may not be reliable. 
All the numerical methods and the renormalization group 
analysis need to study large system sizes with compli- 
cated computation processes. Therefore, it is highly de- 
sirable to find an efficient and general method to charac- 
terize finite-temperature phase transitions in both quan- 
tum and classical systems. 

In this Letter, we point out that the partial entropy, a 
counterpart of the von Neumann entropy for thermody- 
namic systems, captures the common feature of all phase 
transitions, i.e., the information of critical fluctuations. 
With two models (one classical and one quantum), we 
show that close to the critical temperature the derivative 
of the partial entropy shows perfect finite-size scaling be- 
havior even for quite small system sizes. The critical tem- 
perature and critical exponents can be determined by the 
inflexion or the scaling law of the partial entropy. This 
provides a powerful tool to quantify finite-temperature 
phase transitions in a variety of interesting models in 
condensed matter physics. 

In the study of quantum phase transitions, one is con- 
cerned with the ground state properties as described by 
the density matrix |$o)(^ r o|- Crucial information on 



quantum correlation or entanglement between a subsys- 
tem p and the rest p exists in the reduced density matrix 
p p (a) = irp|^ r o)(^o| 5 as is captured in the von Neumann 
entropy, E v = —trp p lnp p . It has been shown that singu- 
lar behavior in the von Neuman entropy occurs as a func- 
tion of control parameters as_the system goes through a 
quantum phase transition 
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The concept of von Neumann entropy can be straight- 
forwardly generalized to thermodynamic systems at fi- 
nite temperatures T. The density matrix now reads 
p(T) — exp (—H/T)/Z, where H is the Hamiltonian, and 
Z is the partition function. One can similarly define a re- 
duced thermal density matrix p p (T) = trpp(T), and con- 
sider the partial entropy S P (T) = —trp p {T)\np p {T) = 

— X^n=i?'« m P«i where Dh is the dimension of the 
Hilbert space of the subsystem p, and p n are the eigenval- 
ues of p P {T). For a classical system, the trace operation 
is replaced by summing over the classical states. The 
partial entropy is determined by the probability distri- 
bution of the subsystem. It also measures the quantum 
and classical correlation between the subsystem and the 
rest of the system. As is shown below, the partial entropy 
in fact captures the main feature of the critical fluctua- 
tion and therefore shows singular behavior close to the 
critical temperature. Its inflexion gives the information 
of the critical point. 

As our first example, we study the two-dimensional 
(2D) Ising model. It is well known that this system is ex- 
actly soluble, undergoing a second order phase transition 
at T c = 2/arcsinh(I) « 2.26919J/fc B and its criti- 
cal behaviors have been studied very well. It is therefore 
an ideal system to test our method. The Hamiltonian is 
H = — Ylfij) a i a j> where- of = ±1 is the spin along z- 
direction on site i and (ij) indicates bonds between near- 
est neighbor sites. We consider the L x L square-lattice 
case and use the periodic boundary condition. We focus 
our attention on the subsystem of two nearest neighbor 
sites. The reduced density matrix is obtained by tracing 
all the spins except those two. Since the system is trans- 
lational invariant, p P {T) is independent of the choice of 
the bond and takes the form p p (T) = [l+7(T)of<7f]/4 by 
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FIG. 1: The derivative of the partial entropy S' p (T) versus 
temperature for L = 3 — 6 are plotted. A maximum appears 
at certain temperature T m for a given L. On increasing L, the 
peak becomes more pronounced and T m shifts accordingly to 
the critical temperature of the 2D Ising model T c — 2.26919. 

a simple symmetry analysis, where 7(T) is a parameter 
depending on the temperature and system size L. Then 
we obtain the partial entropy as 

S P (T) = 2 In 2 - \ {7!*^ + Ml - 7 2 ]} • (1) 

Thermal fluctuations increase with temperature, so 
does the partial entropy. When T — > 0, the spins are 
ordered either up or down. The parameter 7(0) = 1 
and the partial entropy takes the minimum value of In 2. 
At extremely high temperatures T 00, all the four 
states have the same probability to occur. In this case 
7(00) = and the partial entropy takes the maximum 
value 2 In 2. The partial entropy increases monotonically 
between these two extreme values which are independent 
of L. More interestingly, the derivative of the partial en- 
tropy S' p (T) has a maximum, corresponding to fastest 
growth of the partial entropy. The peak at the maximum 
sharpens as the system size increases (Fig. [J), and the 
maximum value diverges logarithmically with the system 
size (FigFJ]). This singular behavior indicates a critical 
point of our system. 

Exact calculations are performed for system sizes L = 
3—6, and Monte Carlo simulations are done for large sizes 
up to L = 50. The straight line fit in FigEl S' p (T m ) = 
0.42034 In L + const, is from the first four points, and 
it is also followed nicely by the Monte Carlo data. The 
temperature T m at the peak of S'JT) shows a size de- 
pendence linear in 1/L (Fig[3]). Just from the first four 
points, we find the fit T m = 2.27802 - 0.58995X -1 , which 
turns out to be also well followed by the Monte Carlo data 
for larger sizes. A critical temperature, T c = 2.27802, is 
extracted from the above fit as the limiting value of T rn at 



FIG. 2: The maximum values of the derivative of the par- 
tial entropy S' p (T m ) for L — 3 — 6 (black dots) depend lin- 
early on InL (dotted line). Monte Carlo results for larger 
L = 10, 20, 30, 40, 50 (circles) fall on this straight line, con- 
firming the logarithmic divergence for a second-order phase 
transition. 
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FIG. 3: The peak temperature T m versus logarithm of the 
system size is depicted to quantify the phase transition tem- 
perature T c . The black dots for L = 3 — 6 are from 
the exact numerical calculation while the circles for larger 
L — 10, 20, 30, 40, 50 are from the Monte Carlo simulation. 
The dotted line is a fit with the formula T m = 2.27802 - 
0.58995L" 1 from the L = 3 - 6 data only. The L -> oo limit 
is very close to the exact value 2.26919. 



L — > oo. This is very close to the exact value of 2.26919. 
We have thus seen the effectiveness of the partial entropy 
method in providing accurate information on the critical 
point from fairly small system sizes. 

We can also study the scaling behavior of the partial 
entropy as a function of both the system size and temper- 
ature. We observe that S' p (T) - S' p (T m ) - Q[L(T-T m )], 
where the scaling function Q(x) ~ Coo In a; for large x, 
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FIG. 4: The finite size scaling of the partial entropy is per- 
formed. The deviation of the first derivative of the partial 
entropy from its maximum is only a function of L(T — T m ). 
All the data from L = 3 to L — 6 fall on a single curve, indi- 
cating a perfect scaling behavior of the partial entropy around 
the critical temperature. 



and Q(x) ^ for very small x [15jj . We find that all the 
data from different system sizes L converge to a single 
curve, which is shown in FigJU These results establishes 
that finite size scaling is present in the partial entropy. 

There is a direct relationship between the partial en- 
tropy and thermodynamic quantities, which explains why 
singular behavior of the partial entropy can be used 
to characterize the critical point and associated scal- 
ing properties. We observe that the density of inter- 
nal energy may be found as u(T) = L~ 2 trH p{T) = 
-2tr p p p (T)(crf<T$) = -2j(T). Therefore, the partial en- 
tropy Eq. ([T]) can be determined uniquely by the internal 
energy density u. Moreover, the derivative of the partial 
entropy can be found as S' p {T) = Tds(T) ln[(2 - u)/(2 + 
u)]/(AdT), where s(T) is the density of entropy of the 
whole system and we have used the thermodynamic re- 
lation du/dT — Tds/dT. In the neighborhood of the 
critical point, the internal energy density u lies some- 
where in the middle of the interval (—2,0) and varies 
smoothly with temperature (with continuous first deriva- 
tive). Therefore, the singular point of S' (T) coincides 
with that of the derivative of the global entropy density 
s(T). Therefore, one can indeed use the partial entropy 
to quantify thermodynamic phase transitions. 

Moreover, the partial entropy is a quantity more suit- 
able for finite-size studies than standard thermodynamic 
quantities, in that scaling behavior sets in much earlier 
in the former than in the latter. This allows precise 
determination of the critical temperature, for example, 
from relatively small system sizes using our method. For 
contrast, we performed finite-size calculations for ds/dT, 
finding that its maximum in the temperature dependence 
diverges as a polynomial rather than a linear function of 



InL. Also, the peak temperature T m of ds/dT is non- 
linear in 1/L. The data for L = 3 — 6 can be nicely 
fitted (with an error less than 0.001) by the function 
T m = 2.3373 - 1.50437L" 2 - 493 . However, its extrapo- 
lation (2.3373) to infinite size is far from the true critical 
temperature. One may take this to mean that the co- 
efficients and the exponent of such a fit are modulated 
slowly in L (such as logarithmic). Another interpreta- 
tion is that there are subdominant terms in finite-size 
scaling which do not decay quickly with the system size. 
In any case, it is very clear that one cannot obtain useful 
results from thermodynamic quantities when the system 
sizes are not very large. On the other hand, the partial 
entropy does seem to be free from such complications. 

It remains to be explained why the partial entropy is 
superior to the global entropy in finite-size scaling. At 
this moment, we do not have a clear answer, but offer 
the following observation which may shed some light to 
this question. The basic ingredient of the partial en- 
tropy method is quite similar to that of the renormal- 
ization group transformation. As is well known, in the 
later approach, information about the critical fluctuation 
remains unchanged, because the critical point is a fixed 
point of the renormalization group transformation. The 
partial entropy captures the essence of critical fluctua- 
tions of the system. 

So far we have been concerned with a classical sys- 
tem, we consider next a quantum Heisenberg model on 
a cubic lattice. In this model, the critical fluctuation is 
much weaker than that in the 2D Ising model, because 
the critical divergence follows a power law in the former 
while it follows a logarithmic law in the latter. However, 
the partial entropy method still works very well in this 
quantum system. The Heisenberg Hamiltonian reads, 
H = —2J2(ij) & ' Sj> where Sj = at/2 is the spin-1/2 
operator and (ij) indicates bonds between nearest neigh- 
bor sites. This model has a second-order phase transition 
at the critical temperature T c = 1.6778 ± 0.0002 as de- 
termined by high-accuracy quantum Mote Carlo simula- 
tion and phenomenological renormalization-group analy- 
sis 0< 

The reduced density matrix for a nearest neighbor pair 
of sites can again be found in a simple form, p p (T) = 
1/4 — | 2u(T)/9l5i • S2, based on a symmetry analysis 
[171 . Il8| . Its coefficient is related to the internal energy 
density u{T) by tracing the reduced density matrix with 
the Hamiltonian. The partial entropy can then be ex- 
pressed as S P (T) = -{[9 - 2u][ln(9 - 2u) - 2 In 6] + [3 + 
2][ln(3 + 2) — In 12]}/12. These expressions remain valid 
for finite system sizes under periodic boundary condi- 
tions. We use quantum Mote Carlo simulation with a 
stochastic series expansion algorithm [19( to calculate the 
density of internal energy and then to obtain the partial 
entropy from the above formula. 

We will show that this critical temperature can be ob- 
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tained accurately by using the partial entropy method 
with the calculation for small-size system. 
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FIG. 5: (a) The derivative of partial entropy shows a peak at 
certain temperature, (b) The finite-size scaling of the deriva- 
tive of partial entropy. 

As before, the partial entropy is monotonically increas- 
ing with T, while its derivative S' p (T) arrives at a max- 
imum at certain temperature. The peaks of S' p (T) for 
linear sizes of L = 4 — 12 are shown in detail in Fig. 
[Sfa). The peaks sharpen with increasing L, and suppose 
to become singular at L — ■> oo. The different curves can 
be collapsed on to a single one, shown in Fig. [5{b), by 
the following scaling relation 



S p (oo) = S p (L) + gL a /\ 
[S p (t,L)-S' p (oc)]\t\ a = f(tL 1 /»), 



(2) 



where t = 1 — T/T c , f is an universal function and g 
is a constant. Our result yields the critical exponents 
a = -0.1116 ±0.0005, v = 0.705 ±0.003 and the critical 
temperature T c = 1.677 ± 0.001, which agree very well 
with those obtained earlier 1(J 



If we use data only from L — 4 — 8, the fitting to a scaling 
function then yields a = -0.703 ± 0.003, v = 0.1196 ± 
0.0005 and Tc = 1.678 ± 0.002, which are already very 
good. On the other hand, thermodynamic quantities, 
such as the specific heat, show good scaling behavior only 
for L > 8 [23|. 

In conclusion, we suggest that the partial entropy is 
quite an effective tool to quantify the finite-temperature 
phase transitions. The critical temperature can be de- 
termined by the inflexion of the partial entropy or the 
peak of its derivative with respect to temperature. The 
partial entropy shows good finite-size scaling even for rel- 
atively small system sizes. The key point lies in the fact 
that the partial entropy catches the most essential fea- 
ture of phase transitions, i.e., the information of critical 
fluctuations. The advantages of this method are: one 
does not need a pre-assumed order parameter; does not 
need to study a special large-scale correlation function, 
and it is straightforward and efficient. Elements of the 
partial entropy are closely related to the thermodynamic 
quantities or correlation functions via simple symmetry 
analysis. 
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More remarkably, the finite-size scaling for the partial 
entropy starts to work from relatively small system sizes. 
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